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BACKGROUND OF THE INVENTION 



1. Field of the Invention 

The present invention relates to a method for determining 
motion compensation of a moving image to be utilized in an 
apparatus which requires a prediction of a moving image 
such as an image transmission apparatus and an image 
apparatus. 

2. Description of the Prior Art 

With the progress of semiconductor technologies, meth- 
ods for deterrniniiig motion compensation to be utilized for 
a transmission of an image and a compression of an image 
have been widely used in many fields in recent years. 
Among such conventional methods for compensating for 
motion of a moving image, there is one method for com- 
pensating for motion of a moving image based on one piece 
of a reference image. 

FIG, 6 is a diagram for showing the concept of the 
conventional method for compensating for motion of an 
image. Referring to FIG. 6, a moving image signal is a set 
of images which are sampled with an equal time interval tO 
on the time axis. For example, an NTSC signal has images 
sampled at every Veo second for each field and. a PAL signal 
lias images sampled at every Vso second for each field. When 
a certain object of which images are to be picked up is 
moving, for example, the spatial position of an object A in 
an M-th image is deviated from the spatial position of an 
object A 1 in an (M-l)-th image by a portion of a move of the 
object during a period of tO. Now, consider a case for 
predicting the M-th image from the (M-l)-th image. In 
order to make a determination of the M-th image with a high 
level of precision by compensating for motion of the object 
from an input image to a reference image during a time 
difference of tO, the M-th image is divided into blocks 
including at least one pixel, and a move of each block from 
the (M-l)-th image to the M-th image is detected so that a 
pixel value of the image at a position deviated by the portion 
of this move is set as a determined value. This will be 
explained with reference to FIG. 6. To obtain a determined 
value of a pixel X of the M-th image, a pixel XT at the same 
spatial position as the spatial position of the pixel X in the 
(M-l)-th image is deviated by a detected move MV of a 
block unit including the pixel X*, so that a pixel X" is 
obtained. This pixel X" is then used as a determined value 
of the pixel X. In FIG. € the block is assumed to have a size 
of 3x3. 

When a signal is an interlace sisal, there are many 
alternative cases considered for predicting compensation for 
motion of an image. For example, either a frame or a field 
is used for the image, and a frame is used for a reference 
image and a field is used for an input image, etc. The basic 
principle is as explained with reference to FIG. 6 above. As 
one of the examples of the above method for predicting 
motion compensation, there is Recommendation 723, 
"Transmission of component-coded digital television sig- 
nals for contribution-quality at the third hierarchical level of 
CCITT Recommendation G.702" which was standardized 
by the CMTT (Conimission Mixtc CCJRJCCUT pour les 
Transmissions Televisuelles et Sonores 3). In this 
recommendation, a determination of motion compensation 
between frames and a determination of motion compensa- 



tion between fields are suitably changed over between the 
two cases. As described above, according to the conven- 
tional method for deternnmng motion compensation of an 
image, a determination is made by compensating for motion 
of the image based on detected morion of the image. 
•Therefore, the conventional predicting method can predict 
motion compensation with a high level of precision even if 
an image is a moving image including movement 

The above-described conventional method for determin- 
ing motion compensation, however, has problems that it is 
not possible to accurately determine motion compensation 
and that, even if it is possible to correctly determination of 
motion compensation, the image density of an image to be 
referred to becomes the image density of a reference image, 
. which makes it impossible to make prediction at a higher 
level of precision. 

For example, in the case of determining motion compen- 
sation by using an interlace signal as a frame and generating 
a block from this frame, frames are combined together to 
compensate motion of an image by disregarding a difference 
in sampling positions, due to a time difference, between two 
fields within a frame. Accordingly, when correct sampling 
positions of the fields are considered, there is such a case that 
motion compensated in the first field and motion compen- 
sated in the second field do not coincide with each other. An 
example of this case is shown in FIGS. 7 A to 7C. Referring 
to FIGS. 7A to 7C, an input signal is an interlace signal (FIG. 
7A). Interlace signals are combined together in a frame to 
determine motion compensation. When a vertical compo- 
nent of a motion detected now is 1, the first field of the M-th 
frame is predicted from the second field of the (M-l)-th 
frame and the second field of the M-th frame is predicted 
from the first field of the (M-l)-th frame, as shown in FIG. 
7B. Moves in the correct field positions is shown in FIG. 7C. 
As is clear from FIG. 7C, the motion for effecting compen- 
sation in the first field of the M-th frame do not coincide with 
the moves for effecting compensation in the second field of 
the M-th frame. As explained above, when morion compen- 
sation of an image is made by handling an interlace image 
as a frame, the motion for effecting compensation are 
different between the first field and the second field. In a 
vector in which this phenomenon occurs, there is a problem 
that the precision of the level of prediction is deteriorated. 

Next, consider a case of cbtermining motion compensa- 
tion of an image as an image of a correct position without 
disregarding a time difference, of sampling between images 
as described above. As examples of this case, there is a case 
where motion compensation is deterrnined for an interlace 
signal by generating a block from a field, and a case where 
motion compensation is determined for a noninteriace sig- 
nal. In the above cases, motion compensation is predicted by 
using an image at a position of a correct time. Therefore, 
there arises no such problem which occurs in the case of 
determined motion compensation by generating a block 
from a frame of the interlace signal as described above. 
However, in this case, motion compensation is deterrnined 
from one piece of reference image and the pixel density of 
an image to be referred to becomes the pixel density of the 
reference image, so that there is a limit to carrying out a 
determination of motion compensation at a higher level of 
precision. FIG. 8 shows a case of determined move com- 
pensation by generating a block from a field for an input of 
an interlace signal. In this case, determination of motion 
compensation is carried out by using a field image as a 
reference image. Therefore, when a motion vector is O there 
is no sampling point at a position necessary for making a 
determination on the reference image and, accordingly, a 
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a frame, the case for compensating motion based on .VM > nei ^ rf precislon . 

K.^d«^i»-^ dte 2^^^2« ^ to the P-sent invention a vector for 

pixel density in the case of compensating a ww»« ™£ ^ compensation of a time position of the reiei- 

a frame Thus, there is a limit to carrying out a deterrwnahon carrying out ccrcup^ ^ f motion of the image 

So? compensation at a high level of prefer .when ^» ^interval, so that it is not necessary 

motion compensation is carried out ba ^°" * fl .^^ to detert again the motion vector for correcting the time, and 

problem also arises ^^Z3g£?£££ at a high level of precision can be 

"EE- byusi n g aninteri aC es ig n,asaninp U tsi g na la n d 

higher level of precision. 5SX£ motion compensation to a frame imag^ thus 

SUMMARY OF THE INVENTION ensuring a deterrmnation^ajl^ precision level of moUon 

With a view to eliminating the above-described or oblems ^ C0 ^**2T*1 s^c vataT is used for a block of each 

of the prior-art technique, it is an object of he present mch wnole or part of spatial position of 

Sveatta, to provide a method for determining motion ^^^^ ^ blocks of a plurality of 

compensation with a very high level of precision by utilizing each .J£g ftS mo|ion detected at a certain time 

a plurality of pieces of reference images. gecesj ? P * includin at least one pixel, ,t is no 

in order to achieve the above-described object of the 25 ut motion detec tion a plurality of times 

present invention, the method of the present invention of me pluraU ty of input images, thus 

Koines motion compensation of an input ^b^« determination of motion compensation at a high 

a motion vector of a reference image from ^ ^ G f precision. 

rx3sitionofmereferenceimagetoapositionofttiereferer.ee levei y 

Image sampled at a first set time, and the meftod includes 30 BRffiF DES CRIPTION OF THE DRAWINGS 

^tttttSS^ZStt ^.nsadiagramfore.plainingOie.rstem^dimentof 

of the input image and also consists of a plurality of pixels, foe present invention; 

and calculating a motion vector of the reference image by ^ 2A and ^ ^ diagrams for explaining the second 

calculating a move at the first set time of a block unit which 35 embodlment of the present invention; 

is a part of the reference image and also consists of a ^ is a diagram for explaining a block for determining 

plurality of pixels, to thereby calculate motion compensation ensatioI1 using a fram e as a base; 

of the input image at a desired set time both from the motion diagrams for explaining the third 

vecVor of the input image and from the motion vector of the ^ ^f^nt invention; 

reference image. . 40 . diagram for explaining the fourth embodiment 

J&J»S.1«i=»S 0 €^E^U-«gtheco„. 
^„i^«S^fi^«^3^^ veSnal meuiod^Lerminifg motion compensation; 

SST SdSSi vectors of input images by of ^ conven tional method for determining motion com- 
calculatine motion at a second set time of block units, each pensat ion between frames; and 

blockforming a part of each input image and also consisting g ig a for explaining the convenuona 

of^ PluraUty of pixels, and a unit for calculating a motion method for determin i ng motion compensation between 
vector of the reference image by calculating a i motion at the 50 fields 

^^"^^S^ypSXSSt pHSCRIPTIONOF^BREFEKKE. 
thTs! motion vectors of the input images to be the same, to EMBODIMENTS 
thereby calculate motion compensation of the «^™«" pro 1 is a diagram for explaining a first embodiment of 

at a desired set time both from the motion vectors of the 55 ™K1 » inV entioTFIG. 1 assumes the determination of 
input images and the motion vector of the reference unjg* the pre °%££!Zl ^ Qa m Macc signal as an 
Therefore, according to the present invention, a time mouo mpo ^ ^ ^ fr ^ge 

position of a reference image is compensated by^ using a inputs ^g fa ^ m ^ ^ fa ^ 

Certain motion vector depending on the need s > £a : a ^ ^ is in Ae M . th field and a reference miage is 
pluratity of pieces of reference images JJ^J 60 TbX thT^-l)-th field and the (M-2)-tli field. Now, 

times according to the motion of a block unit includmg at to bom 1 J for ^^g movc 

least one pixel, which is detected at a ^ompTnsation of a certain block is to be detected in a 

become images of the input image at *ov? ^ ^ ^ d ^ 

vals from theposltion of the input image. Thus, it ^possible J» ^ lanation . of the detected 

to obtain a pluraUty of pieces of images at * j£ 65 Sve S oniy motioVin the . vertical direction will be 

above-described time intervals from the position ,of ^themput moves o y ^ ^ as ^ y) In ^ 

image. By combining these images together, it is possible to consiaereo, 
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case, x represents a field number and y represents a line 
number. Line numbers are placed in the order of ^1,2,. . . , 
starting from the bottom in a line interval of the frame. A 
JS of each pixel in a vertical direction is expressed 
always in the unit of a frame line. 

Now, consider a case for obtaining a determined ^value of 
QA 1). When a vertical component of a detected MV is 1, 
a determined value of motion compensation of a (M, 1) 
becomeTa pixel value at aposition of (M-2, 2). Next a time 
X ^corrected so that the position of the .reference 
image in the (M-l)-th field becomes an ^^P 0 ^ 
of the (M-2)-th field. A vector for correcting this time 
position is set as MV adj (adjustment vector). In calculating 
toe MV adj from the MV, the following relahonsrup can be 
easily drawn when it is assumed, for example, that motion 
from the (M-2)-th field to the M-th field is constant: 
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Therefore, when the vertical component of the MVis 1, the 
vertical component of the MV adj becomes -0.5. When this 
is applied to the positional correction for correcting ttie 
positions of the (M-l)-th field to the positions of Ae 
0M_2)-th field, a (M-l, 2) in the (M-l)-th field is corrected 
to the position of (M-2, 2.5) in the (M-2)-th field, as shown 
in FIG. 1. After the above operation, the position of (M-A 
2) which is the determined value of motion compensation of 
the a (M, 1) is obtained from pixel values of the (M-2)-tn • 
field and the (M-l)-th field which is the result of a time 
positional correction. In this case, when a necessary pixel 
value is to be obtained by a weighted average, which is 
inversely proportional to a distance, from near-by pixel 
values, for example, the pixel value at the position of the 
(M-2 2), that is the determined value of motion compen- 
sation of the a (M, 1), is obtained by the following expres- 
sion: 



afJA-X iy3+2*a(M-l,2)/3 
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Although the above explains a determination of motion 
compensation taking account of only vertical components, a 
similar operation is also applied to the case for determining 
motion compensation for an image having both vertical and 
horizontal components. 

As described above, according to the first embodiment ot 
the present invention, a time position of a reference image 
is corrected by using a motion vector as required so that a 
plurality of pieces of reference images sampled at different 
times become an image at a time which is positioned within 
a certain time interval from the position of the input image, 
according to detected motion at the above time interval of a 
block unit including at least one pixel. Therefore, it is 
possible to obtain a plurality of pieces of images at positions 
which are separated from the input image by the above time 
intervals. A reference image with high pixel density is 
obtained by combining these pieces of images, and a pixel 
value at a position which compensates the detected motion 
is calculated by using the reference image of high pixel 
density, and the calculated pixel value is used as a deter- 
mined value. As a result, there is an effect that it is possible 
to carry out a determination of motion compensation of an 
image at a very high precision level. 

The assumptions used in the above description of the first 
embodiment are flexible and the following alternative 
assumptions can also be accepted. Instead of assuming two 
images for a reference image, any plurality of number of 



nieces of images can also be used. Instead of assuming the 
Son offte Plurality of reference images as the previous 
SjSd its previous image, these positions can also be set 
Sly Instead of assuming constant motion of an image 
S^uSw the MV adj from the MV, any assumption of 
motion can also be used according to a certain rule for 
Sating the MV adj from the MV ^JgJ 
weighted average which is inverse proportional to "Stance 
lorn near-by pixel values to obtain a pixel value at a 
nZssm Position, a coefficient of a low-pass filter, for 
example; L also be used to obtain the pixel value at a 
necessar^ position. Instead of using interpolation, for obtain- 
ing a necessary pixel value, extrapolation, for example, can 
also be used to obtain the necessary pixel value. 

Further, although the vector M adj for correcting positions 
of a plurality of pieces of reference images is calculated 
from a motion vector MV which is detected in a block unit 
in the above-described first embodiment of the present 
invention the MV can also be detected independently 
(M-l)-th field and the <M-2)-th field. In this 
casTby an independent detection of the MV, the time 
correction can be effected based on a more accurate motion 
of the image. Thus, this method has an effect that a deter- 
mination of motion compensation of an image at a higher 
25 level of precision can be ensured. 

Further, although an interlace signal is used as an mput 
signal and a field image is assumed as each image in the 
above-described first embodiment of the present invention, 
a non-interlace image can also be used, with an effect that a 
determination of motion compensation of an image can be 
ensured at a higher level of precision, for the same reason as 

explained above. . - 

Next a second embodiment of the present invention for 
determi'ning motion compensation of an image by using an 
interlace signal as an input signal and using a frame as an 
input, will be explained. FIGS. 2A and 2B are diagrams for 
explaining the second embodiment of the present inventions. 
Referring to FIGS. 2A and 2B, a reference image is in two 
fields of the previous frame, that is, the (M-l)-th field and 
the (M-2)-th field, and an input image is in two fields ot uxe 
current frame, that is, the M-th field and the (M+l)-th field. 
In FIGS. 2A and 2B, it is assumed that a motion vector tor 
determining motion compensation of a certain block is 
obtained within an input image and a reference frame and 
between fields of the same phase as that of the M-th field, for 
each two fields of the current frame. The motion vector for 
predicting move compensation of the M-th field is expressed 
as MV(M) and the motion vector for the (M+l)-th field is 
expressed as MV(M+1) A pixel value of each pixel position 
is expressed in the same manner as that of the first embodi- 
ment To simplify the explanation of FIGS. 2A and 2B, of 
the detected motion, only the move in the vertical direction 
will be considered. . 

In FIGS. 2A and 2B, a determination of a pixel withm the 
M-th field is carried out by using images in the (M-l)-th 
field and the (M-2)-th field, in exactly the same operation as 
that of the first embodiment of the present invention. For 
example, when the vertical component of the MV(M) is 1.5, 
the determined value of a(M, 1) becomes the pixel value at 
60 the position of (M-2, 2.5) according to the operation which 
is the same as that of the first embodiment, and this value is 
obtained by the following expression: 
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fl(Af-2,l)/7+6MAf-l,2)/7 
Similarly, in the same manner as that of the determination of 
a pixel within the M-th field, a pixel within the (M+l)-tn 
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a tjxc ^ and. FIGS 4 A and 4B arc diagrams for 
field is determined from the two fields of referen^ g^S'lWid embodiment of the present invention 
frame, that is, the (M-l)-th and (M-2)-th ^™cinJ«J to FIG. 3, a reference image is in the (N-l)-th 

of determination in this case is the same as the method for the ( ^_ 2) and (M-l) fields, and an input 

deterrninmgapixdwitMntheM-thfiel^ J™. * J «, the ^ fta J faf &e M4h aBd (M+i^th 

(M-2)-th field needs to be corrected to the P^*«Jf 5 £f£ e ^ assume mat a block for carrying out motion 
M-l)-th field. A vector for correcting this time pontoon* ^JjJ^ "Hdng generated from the frame. Assume 
set as MV adj (M+l). In calculating the ^S„ v Lor is to be obtained in the block unit 

theMVCM+1), when the motion from the '<&-*>*J^* JJ™^ ^ ^ of tUe N . m frame, from the 
the (M+lHh field, for example, are constant, the following f^™^^ £ tus of ^ block in this case is shown 
relationship can be obtained easily: \ ^ 3 ^ of the method for determining motion 

compensation based on a field, the following method can be 
M v aai m+WV(M+W considered. The reference image is in the two fields of Uie 

W+WW+W (N-l)-th frame and the input image is in the two fields of the 

Therefore when the vertical component of the MV(M+1) is l5 ^ fnxoCt The detecting interval of the MV is the two-field 
1 the vertical component of the MV adj (M+l) becomes 0.5. interva l. However, the pixels included in the above blocK 
As shown is FIGS. 2A and 2B, when the (M-2)-th field is haye ^ same motion vec tor MV for both the pixels m the 
positionally corrected to the position of the (M-l)-th field, M-th fleld and the pixe i s i n the (M+l)-th field, 
the a(M-2, 3) is positionally corrected to the position of th ^ Qther words> in the case of the third embodiment 

(M-l 2.5). After the above operation, the position of the 2Q raotion vec tors to be used for pixels within a block generated 
(M-l 3) which is a determined value of the a(M+l, 2) is from the above frame take the same value regardless ot 
obtained from the pixel value of the (M-l)-th field and the wnet her the pixels belong to the M-th field or the (M+l)-th 
pixel value of the (M-2)-th field of which time position has field Thc other operations become the same as those ot the 
been corrected. When a necessary pixel value is to be second embodiment FIGS. 4A and 4B show the case that the 
obtained by a weighted average, inversely proportional to a 25 vertiC al component of the MV is 1. Although the above 
distance from near-by pixel values, for example, a deter- CX piai n s the case of determining motion compensation ot an 
mined value at the position of the (M-l, 3), that is, a ^ for only the ver tical component, a similar operation is 
determined value of motion compensation of the a(M+l, 2), alsQ out for the case of determining motion vector ot 

is obtained by the following expression: an having both vertical and horizontal components. 

30 As described above, according to the third embodiment of 
the present invention, the same motion vector is used for 
a(M-i,4V3+2*«(Af-2,3y3 pixcls m ^ ^ fi e ids positioned within a predeter- 

Although the above explains the determination of motion mined spatial area such as a block -£>»£"V £££ 

=S=S-3S ■ =3SS=33=s: 

using an interlace signal as an input signal and by setting a ^^Pf^^^f^"^ MV , 'the calculation 

from either the MV(M) or tne mvkmti), uic a th _ ,;„ me va i ue c f the motion vector is 

method for obtaining a pixel value at a necessary posiUo^ bl^s of a plurality of pieces of Input 

andeitherinterpoladonorextrapolauon can also be selected Mtectad -*<££^*» P J ecU £ is a block of 

m«lo» wane, in U>« ■»»»» « f *» ■ J" ™?' ' * iilJSto Tta fouitt embodlmtut »te As 
<h« i. »f Ctfrf l?JS5S?So» of <1» to. e n*odi™.., »d .„ 
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a motion vector (M V) for determining motion compensation 
of a certain block is to be detected in a two-field interval, that 
is, between the M-th field and the (M-2)-th field. To 
simplify the explanation, of the detected motion, only 
motion in a vertical direction will be considered, and a pixel 5 
value at each pixel position is expressed in the same manner 
as that of FIG. 1. 

Now consider the case of obtaining a determined value of 
a(M, 1). When it is assumed that the vertical component of 
the detected MV is 3, the determined value of move com- 10 
pensation of the a(M, 1) becomes the pixel value at the 
position of (M-2, 4). First, this pixel value is obtained from 
the pixel value within the (M-2)-th field. When the pixel 
value is to be obtained based on a weighted average, 
inversely proportional to a distance, from near-by pixel 15 
values, for example, the pixel value at the position of the 
(M-2, 4) is obtained by the following expression: 



<i(A/-2,3y2+fl(Af-2,5y2 20 

Next, based on the above MV, motion of the input image 
from the (M-l)-th field to the M-th field is calculated. The 
time difference between the M-th field and the (M-l)-th 
field is Vi of the time difference between the M-th field and 
the (M-2)-th field. Accordingly, this motion vector can be 
considered to be MV/2. Since the vertical component of the 
MV is now 3, the vertical component of MV/2 becomes 1.5. 
Accordingly, when a determined value of motion compen- 
sation of the a(M, 1) is obtained from the image in the 
(M-l)-th field, this becomes the pixel value at the position 
of (M- 1, 2.5). This pixel value is obtained from a pixel value 
within the (M-l)-th field. When the pixel value is to be 
obtained by a weighted average, inversely proportional to a 
distance, from near-by pixel values, for example, the pixel 
value at the position of (M-l, 2.5) can be obtained by the 
following expression: 



25 
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Based on the two determined values obtained above, a mean 
of the two determined values is obtained and the result is 
used as the determined value of the a(M, 1). 

Although the above explains the case for determining 
motion compensation of an image for only the vertical 45 
component, a similar operation is also carried out for the 
case of determining motion compensation of an image 
having both vertical and horizontal components. 

As described above, according to the fourth embodiment 
of the present invention, motion of an input image from a 50 
plurality of pieces of reference images sampled at different 
times according to detected motion at certain time intervals 



pixel value at a necessary position within each reference 
image, and either interpolation or extrapolation. For calcu- 
lating determined values from a plurality of pixel values 
obtained from the respective reference images, there are 
other alternative methods than a simple averaging method 
such as a weighted average method and a method for 
calculating by using a coefficient of a low-pass filter. 
Although description has been made of the case for deter- 
mining motion compensation based on a field of an interlace 
signed in the present embodiment, it is needless to mention 
that the effect of the determination does not change if a 
frame is used as a base or a noninterlace image is used as a 
base as shown in the second and third embodiments respec- 
tively. 

According to the present invention, as is clear from the 
above-described embodiments, a time position of a refer- 
ence image is corrected by using a motion vector as required 
so that a plurality of pieces of reference images sampled at 
different times according to detected motion at certain time 
intervals of a block unit including at least one pixel become 
images at times separated from the input image by the above 
time intervals, so that it is possible to obtain a plurality of 
pieces of images at positions separated by the above time 
intervals from the input image. By combining the plurality 
of pieces of images together, a reference image of high pixel 
density can be obtained and a pixel value at a position which 
has been compensated by the detected motion is calculated 
by using the reference image of high pixel density, so that 
the calculated pixel value is used as a determined value. 
Thus, there is an effect that it is possible to determine motion 
compensation of an image at a very high level of precision. 

Further, according to the present invention, a vector for 
correcting a time position of the above reference image can 
be calculated based on motion detected at a certain time 
interval, which does not require a detection again of a 
motion vector for correcting the time position, so that this 
has an effect that motion compensation at a high precision 
level can be ensured. Further, since an interlace signal can be 
used as an input signal and a reference image can be in two 
fields of a certain frame, the above determination of motion 
compensation can be applied to a frame image, thus ensuring 
a determination, at a high precision level, of motion com- 
pensation based on a frame. 

Further, since the same value can be used for a block of 
each input image among blocks of a plurality of pieces of 
input images, each block having its whole or part of spatial 
position superposed with that of the other blocks, as a move 
detected at a certain time interval of a block unit including 
at least one pixel, it is not necessary to carry out a plurality 
of detections of moves of many block in a plurality of input 
images so that there is an effect that a determination of 
motion compensation at a high precision level can be 
ensured. 



of a block unit including at least one pixel is calculated . SJSJ^J 

le above detected motion, and a pixel value at e^* b /\^ c claim: 

compensated by the calcmated"^»- A method of determining motion compensation for an 



based on the 

position which has been 

motion portion for each reference image is calculated, so 
that it is possible to obtain a plurality of determined values 
of motion compensation from the plurality of pieces of 
reference images. Since a determined value of the input 
image is calculated from the plurality of determined values, 60 
noise can be eliminated if noise is included in the determined 
values, thus ensuring a determination at a high precision 
level, of motion compensation. 

In the manner similar to the case of the first embodiment, 
it is also possible in the fourth embodiment to freely select 65 
the number of pieces of reference images, the positions of 
the reference images, the calculation method for obtaining a 



input image from motion vectors between the input image 
and a plurality of reference images, said method comprising 
the steps of: 

(a) calculating a motion vector MV1 between the input 
image and one reference image of said plurality of 
reference images from a motion of at least one block 
unit at a second set time interval T 2 between the input 
image and said one reference image, said at least one 
block unit being a part of said input image and com- 
prising a plurality of pixels; 

(b) providing a motion vector MV2 between at least two 
reference images of the plurality of reference images at 



